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ABSTRACT 

We present a determination of the real space galaxy correlation 
function, £(r), for galaxies in the APM Survey with 17 < bj < 20. 
We have followed two separate approaches, based upon a numeri- 
cal inversion of Limber's equation. For SI = 1 and clustering that 
is fixed in comoving coordinates, the correlation function on scales 
r < 4/i _1 Mpc is well fitted by a power law £(r) = (r/4.5) -1 * 7 . There 
is a shoulder in £(r) at 4/i _1 Mpc < r < 25/i _1 Mpc, with the corre- 
lation function rising above the quoted power law, before falling and 
becoming consistent with zero on scales r > 40/i -1 Mpc. The shape 
of the correlation function is unchanged if we assume that cluster- 
ing evolves according to linear perturbation theory; the amplitude of 
£(r) increases however, with ro = 5.25/i _1 Mpc. We compare our re- 
sults against an estimate of the real space £(r) made by Loveday et 
al. (1995a) from the Stromlo-APM Survey, obtained using a cross- 
correlation technique. We examine the scaling with depth of £(r), in 
order to make a comparison with the shallower Stromlo-APM Survey 
and find that the changes in £(r) are within the la errors. The es- 
timate of £(r) that we obtain is smooth on large scales, allowing us 
to estimate the distortion in the redshift space correlation function 
of the Stromlo-APM Survey caused by galaxy peculiar velocities on 
scales where linear perturbation theory is only approximately correct. 
We find that f3 = Sl° 6 /b = 0.61 with the la spread 0.38 < f3 < 0.81, 
for SI = 1 and clustering that is fixed in comoving coordinates; b is 
the bias factor between fluctuations in the density and in the light. 
For clustering that evolves according to linear perturbation theory, we 
recover j3 = 0.20 with la range -0.02 < j3 < 0.39. We rule out j3 = 1 
at the 2a level. This implies that if SI = 1, the bias parameter must 
have a value b > 1 on large scales, which disagrees with the higher 
order moments of counts measured in the APM Survey (Gaztanaga 
1994). 
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1 INTRODUCTION 

The galaxy two-point correlation function £(r) is 
a powerful discriminant between models of struc- 
ture formation in the universe. Analysis of re- 
cently completed galaxy surveys has shown that 



excess correlations are observed on scales larger 
than 10/t _1 Mpc (Maddox et al. 1990, Efstathiou 
et al. 1990, Saunders et al. 1991), compared with 
the predictions of the standard Cold Dark Matter 
model. The correlation function measured from a 
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redshift survey of galaxy positions will be distorted 
by the peculiar motions of the galaxies. The corre- 
lations on large scales will be boosted by coherent 
flows (Kaiser 1987), whilst those on small scales 
are reduced by the virialised motion of galaxies 
within groups and clusters. 

A measurement of these distortions, either 
by resolving the redshift space correlation func- 
tion into harmonic components (Hamilton 
1992), or by comparison with the real space cor- 
relation function gives us information about the 
whole mass distribution, rather than just the lu- 
minous component. To take the latter approach, 
a reliable way of estimating the real space corre- 
lation function, particularly on large scales where 
linear perturbation theory applies, is needed. 

The method normally used to obtain the 
real space correlation function is to try to invert 
two dimensional measures of clustering. The pro- 
jected distribution of galaxies is unaffected by pe- 
culiar motions and angular catalogues usually con- 
tain orders of magnitude more galaxies than red- 
shift catalogues. 

We have described a method for recover- 
ing the real space power spectrum in three dimen- 
sions, P(k), which is the Fourier transform of £(r) 
(Baugh & Efstathiou 1993, 1994; hereafter BE93, 
BE94). We adapted an iterative technique due to 
Lucy (1974) to numerically invert Limber's equa- 
tion (Limber 1954), which relates a measure of 
clustering in two dimensions, such as the angular 
correlation function w(9) or the power spectrum, 
to an integral equation that projects a three di- 
mensional measure of clustering. The method re- 
quires a model for the redshift distribution of the 
galaxies in the survey and assumptions about the 
evolution of clustering with redshift. 

There are several advantages to be gained 
by using such an approach. The result that is ob- 
tained for £(r) is independent of the initial form 
used to start the iterations. If a fit of £(r) was made 
to reproduce the observed w(9), the result would 
be restricted by the parametric form adopted; im- 
portant features in correlation function could be 
missed unless they were anticipated beforehand in 
choosing a shape for £(r). The correlation func- 
tion that we recover is smooth and the method 
converges rapidly to a stable solution. This is be- 
cause the numerical technique is robust and does 
not involve any potentially unstable numerical op- 
erations, such as differentiation, unlike the method 
of Fall & Tremaine (1977) and Parry (1977), who 
proposed using Mellin transforms to invert Lim- 
ber's equation. 

The real space correlation function can also 
be estimated from redshift surveys. Davis and Pee- 
bles (1983) computed the correlation function in 



redshift space as a function of the separation of 
galaxies parallel and perpendicular to the line of 
sight. This function is then projected and is related 
to £(r) by an Abel integral which can be inverted. 
However, the binning of galaxy distribution into a 
two dimensional grid makes the correlation func- 
tion noisy. 

This method has been adapted for sparse- 
sampled redshift surveys by Saunders et al. (1992). 
In sparse-sampled surveys, galaxies are selected at 
random at some set rate from the parent two di- 
mensional catalogue (e.g. at a rate of 1 in 6 for the 
QDOT survey, and 1 in 20 for the Stromlo-APM 
Survey). It can be shown that comparable informa- 
tion can be extracted about the large scale struc- 
ture in the survey, as would be obtained from 1 in 
1 sampling, but with less expenditure of telescope 
time (Kaiser 1986). By calculating the cross corre- 
lation function between the projected redshift sur- 
vey and the parent catalogue, the noise is greatly 
reduced, allowing an inversion of the projected cor- 
relation function to be carried out. 

The method requires a weighting scheme 
for the galaxies, which is calculated by assuming a 
prior form for the correlation function, though it 
is claimed that the weights are not that sensitive 
to the actual form chosen. 

A power law form for the spatial correla- 
tion function can be chosen so that the projected 
cross-correlation function is reproduced. Alterna- 
tively the relation between the spatial and cross 
correlation function can be inverted directly, with- 
out having to restrict the form of the spatial cor- 
relation function. The direct inversion in voles tak- 
ing a derivative of the cross-correlation function, 
which leads to a result that is not smooth, partic- 
ularly on larger scales where the estimated cross 
correlations are noisier. 

Loveday et al. 1995a, b (L95a,L95b) have 
applied this technique to the APM-Stromlo red- 
shift catalogue. One aim of this paper is to com- 
pare these results with those obtained from the 
inversion scheme of BE93. We derive the relativis- 
tic version of the integral equation relating w(9) 
to £(r), in a form that is suitable for inversion by 
Lucy's method in Section 2. The real-space £(r) is 
computed in Section 3 by taking the Fourier trans- 
form of the results for P(k) obtained by BE93. We 
perform the Lucy inversion in Section 4. 

In order to compare our results obtained 
using the APM Survey for galaxies with magni- 
tudes in the range 17 < bj < 20, with those of 
L95a for galaxies with bj < 17.15, we need to ex- 
amine the scaling of our measurement of £(r) with 
survey depth, which we discuss in Section 5. 

We estimate the size of peculiar velocity 
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where the function F(x) depends upon the cosmo- 
logical model used (see equation 56.13 from Pee- 
bles 1980) and u = x\ — £2 (Peebles 1980 equation 
56.16). 

We express the selection function p(x) of 
the survey in terms of the redshift distribution 
(dN/dz) 



M - 



F(x 



■a 3 p(x)dx 



J_ 



dN 



dz, 



(4) 



where J\f is the number density of galaxies per 
steradian and fi s is the solid angle covered by the 
survey. 

The redshift distribution is parameterised 
by the median redshift, Zbj = \AYlz c with 



Figure 1. The kernel function denned by equation 9 
for the case of a spatially flat universe with Q = 1 
and clustering that is fixed in comoving coordinates 
a = (solid line). The kernel with linear evolution of 
clustering in comoving coordinates (a = 2) is shown 
by the dotted line. 



distortions in the Stromlo-APM Survey by com- 
paring the redshift space correlation function of 
L95a with our estimate of the real space correla- 
tion function in Section 6. Finally our conclusions 
are presented in Section 7. 



2 THE INTEGRAL EQUATION 

The spatial correlation function £(r, t) is related to 
the angular correlation function w(9) by Limber's 
equation (Limber 1954), if we make the assump- 
tions that clustering is independent of luminosity 
and that the correlation function tends to zero on 
scales approaching the depth of the survey. 

We shall rewrite the relativistic version of 
Limber's equation (equation 1 of BE93; see also 
Peebles 1980, §56) in a form that is more suitable 
for inversion by Lucy's technique: 



2j OO J O °* 4 f- 2 aV(*)g(M) dxdu 
w(zu) = - 2 . (1) 



x 2 F 1 a 3 p(x)dx 



The co-ordinate distance x is related to the 
physical separation between galaxy pairs that are 
separated by angle 9 on the sky by: 



a 2 [m 2 /_F 2 (x) + x 2 nj 2 ] 
2sin(6>/2), 



(2) 
(3) 



z c (bj) = (0.016(6j - 17) 1 5 + 0.046) /1.412, (5) 

which is a function of the apparent magnitude, 
bj > 17. The redshift distribution is represented 
by the formula 
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(6) 



which was chosen to provide a fit to the redshift 
distribution of galaxies in the Stromlo-APM sur- 
vey of Loveday et al. (1992), and the fainter sur- 
veys of Broadhurst et al. (1988) and Colless et al. 
(1991, 1993) (cf Figure 1 of BE93). Note that 
this formula is different to the redshift distribu- 
tion that would be predicted from the Maddox et 
al. (1990) fit for the APM luminosity function (see 
Gaztanaga 1995). Equation 6 also provides a good 
fit to recently compiled Autofib data in the mag- 
nitude range 17 < bj < 20 (Ellis et al. in prepara- 
tion; G. Efstathiou, private communication). 

We shall approximate the evolution of the 
spatial correlation function measured in terms of 
the comoving separation between galaxy pairs as 



(1 + *) 



(7) 



The parameter a is a function of scale and epoch. 
However, this would make it impossible to invert 
the integral equation, which would then be a func- 
tion of two variables, given an observed function 
of one variable. On small scales, if the approxima- 
tion of stable clustering applies (Peebles 1980), the 
two-point function will grow as 1/(1 + z) 3 . How- 
ever, this paper is mainly concerned with deter- 
mining the shape of £(r) on large scales. In view 
of the low median redshift of bj ~ 20 APM galax- 
ies (z m ~ 0.2 from equation 5), we shall examine 
the cases a = 0, which corresponds to clustering 
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fixed in comoving coordinates and a = 2, which is 
the prediction of iinear perturbation theory. 

We change variabies in equation 1 from u to 
r' = r/a, the comoving separation. Finally, chang- 
ing the order of integration in Limber's equation 
gives us the desired result (c/ Peebles 1980, equa- 
tion 53.1 for the non-relativistic version) 



1 



w(zu) = — / r {(r) K(r/zu)dv, 



(8) 



where the kernel K(r/zu) is defined by the integral 
K(a) 
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In Figure 1, we show the form of the kernel 
for the case of a spatially flat universe, Q = l, with 
the solid line showing clustering fixed in comov- 
ing coordinates (a = 0) and the dotted line show- 
ing clustering evolving according to linear theory 
(a = 2). The mean redshift of galaxies with mag- 
nitudes in the range bj = 17 — 20, predicted by 
our parametric form for the redshift distribution 
(eqn(6)) is z = 0.14. This gives a reduction of 
~ 25% in the amplitude of the peak of the kernel 
function if we assume that the clustering evolves 
according to linear theory. 



3 FOURIER TRANSFORM ESTIMATE 
OF THE CORRELATION FUNCTION 

The power spectrum of galaxy clustering is the 
Fourier transform of the spatial correlation func- 
tion 
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Figure 2. The spatial correlation function obtained 
by Fourier transforming the three dimensional power 
spectrum recovered by BE93 from the APM Survey 
split into four zones. The triangles show the mean of 
these estimates with one sigma error bars, (a) shows a 
log-log plot of ^(r) on scales smaller than 30h~ 1 Mpc. 
(b) shows the form of £(r) on large scales. 



where we now use r for comoving separation and 
k is the comoving wavenumber. 

We can use equation 10 to obtain an esti- 
mate of the spatial correlation function, using the 
three dimensional power spectrum recovered by 
BE93. In addition, this allows us to check the form 
of equations 8 and 9, by taking the spatial correla- 
tion function obtained from the Fourier transform 
and using it to calculate w(9). BE93 show in their 
figure 8, that the power spectrum they recover pre- 
dicts a w(9) that is in excellent agreement with the 
APM data points (taken from Maddox et al. 1990). 

Throughout this paper, we analyse the 
APM Survey split up into four roughly equal strips 
in right ascension (see Figure 2 of BE94). We show 
the Fourier transform of the three dimensional 



power spectrum obtained for each zone by the bro- 
ken lines in Figure 2. The mean of these estimates 
of the spatial correlation function is shown by the 
triangles and the 1 sigma scatter is indicated by 
the error bars. We have extrapolated the form of 
the power spectrum as P(k) oc k~ 125 on small 
scales in the Fourier transform to obtain £(r). Fig- 
ure 2(a) shows the form of the correlation func- 
tion estimated for each zone on a log-log plot up 
to r = 30/t -1 Mpc. The shape of the correlation 
function on larger scales is shown on a linear scale 
in Figure 2(b). 

Finally in this Section, we use equation 8 
to compute the expected w(9) from the correla- 
tion function obtained in each zone. The mean of 
the angular correlation function so obtained for 
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Figure 3. An illustration of the accuracy of the esti- 
mates of £(r) obtained by Fourier transforming the re- 
sults of BE93 for P(k). The points show the APM w(6) 
averaged over four zones with 2<r errors, from Maddox 
et ah (1990). The dashed line is the mean w(6) ob- 
tained from P(k) and the solid line is the mean angular 
correlation function from £(r). 



each zone is shown by the solid line in Figure 3. 
The dashed line shows the average w(9) computed 
from the power spectrum in each zone, using equa- 
tion 5(a) of BE93. In this case, no extraploation of 
the form of the power spectrum to small scales 
was made, in order to show the scale at which 
the extrapolation is important. The points show 
the actual w(9) measured for the APM Survey by 
Maddox et al. (1990), with 2a error bars. 
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Figure 4. The spatial correlation function obtained 
by Fourier transforming P(k), shown by the solid line, 
compared with the result obtained by applying Lucy's 
method to w(6), shown by the points with la errors, 
(a) shows a log-log plot of on scales smaller than 
30h~ 1 Mpc. (b) shows the form of £(r) on large scales. 



APPLICATION OF LUCY'S 
METHOD 



w"(lo/) = r,/LOjK(r,/u>/)t;"(ri)Ar,, (11) 



Following BE93 and BE94, we can numerically 
invert the integral equation (equation 8) using a 
technique based upon Lucy's method (Lucy 1974) 
to recover the spatial correlation function. 

Beginning with a power law form for the 
spatial correlation function (though the result of 
the inversion is not dependent upon the initial 
form chosen for £(r)), we compute the correspond- 
ing angular correlation function and compare it 
to the measured w(9). This comparison is then 
used to generate a new estimate of the spatial cor- 
relation function, and the process is repeated. If 
the n th estimate of the spatial correlation func- 
tion gives us an estimate of the angular correlation 
function as: 



then the revised estimate of the spatial correlation 
function is given by 



(12) 



where w°(uj) is the measured angular correlation 
function. We have replaced the integrals by sum- 
mations and typically used 60 logarithmic bins for 
w(lo) and 30 bins for £(r) in the range r = 0.001 
to r = 150/t _1 Mpc. 

Again, we apply the inversion individually 
to each of the four zones into which we have split 
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Figure 5. The angular correlation function measured 
for APM galaxies in the magnitude range (in order of 
decreasing amplitude); 17 < bj < 18, 17 < bj < 19 
and 17 < bj < 20. (We have omitted the la errors, 
obtained by averaging over zones, for the 17 < bj < 19 
slice for clarity). 



Table 1. Magnitude slice parameters 



bj 


z 


absolute mag 


M B - 5 log h 


17 - 18 


0.069 


-19.47 


-18.47 


18 - 19 


0.101 


-19.26 


-18.25 


19 - 20 


0.143 


-18.95 


-17.95 


17 - 19 


0.097 


-20.17 


-18.17 


17 - 20 


0.138 


-20.87 


-17.87 




10 20 30 40 50 

r hr 1 Mpc 



the APM Survey. The iterations are stopped when 
the w(lo) obtained from the current estimate of the 
spatial correlation function provides a good match 
to the measured angular correlation function for 
that particular zone. 

We plot the mean of the recovered spatial 
correlation functions in Figure 4 with la error 
bars. The solid line shows the mean spatial cor- 
relation function recovered by taking the Fourier 
transform of the three dimensional power spec- 
trum in each zone. The different approaches to es- 
timating the form of the spatial correlation func- 
tion are consistent to within la on scales up to 
~ 20/t -1 Mpc and within 2a up to the maximum 
scale for which the correlation function was recov- 
ered 150/t _1 Mpc. 



5 SCALING WITH DEPTH OF THE 
CORRELATION LENGTH 

The correlation length is defined as the sep- 
aration at which the two point correlation function 



Figure 6. (a) The real space correlation functions ob- 
tained for APM galaxies in the magnitude range; 17 < 
bj < 18 (symbols with 1 sigma errors), 17 < bj < 19 
(dotted line) and 17 < bj < 20 (dashed line), (b) ((r) 
recovered from w(6) measured from galaxies with mag- 
nitudes 17 < bj < 18 (symbols with 1 sigma errors), 
18 < bj < 19 (dotted line) and 19 < bj < 20 (dashed 
line). 

is unity {(ro) = 1- Analysis of the CfA redshift 
surveys has indicated that the correlation length 
that characterises galaxy clustering scales with the 
depth of the survey. Coleman et al. (1988) found 
that the correlation length in volume limited sub- 
samples of the CfA 1 survey increased linearly with 
the depth of the sample. The authors interpreted 
this trend as evidence for a fractal galaxy distri- 
bution. The scaling with depth of the angular cor- 
relations measured for half magnitude slices of the 
APM Survey argues against this conclusion (Mad- 
dox et al. 1990, Peebles 1993). Davis et al. (1988) 
analysed an extension of the CfA survey and found 
that the correlation length increased in proportion 
to the square root of the effective depth. 

Two possible explanations for this be- 
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haviour have been put forward. The volume lim- 
ited samples used in the above analyses typically 
have depths of 100/t -1 Mpc or less, and so could be 
biased by density fluctuations on scale of the sam- 
ple, which makes the mean density uncertain. In 
the CfAl survey, the Local Supercluster biases the 
density to be higher than the true mean density 
of the universe. The APM Survey covers a much 
larger volume and so is not affected by local in- 
homogenities. Alternatively, using deeper volume 
limited samples includes more bright galaxies in 
the catalogue and there is some evidence that 
these galaxies are more strongly clustered than 
faint galaxies (Hamilton 1988, Davis et al. 1988, 
L95a,b). 

In order to make a meaningful compar- 
ison of the real space £(r) measured from the 
17 < bj < 20 APM Survey with the redshift 
space correlation function obtained from the shal- 
lower Stromlo-APM Survey, we need to examine 
the variation of £(r) with effective depth. Using 
the full bj = 17 — 20 slice will give the most ac- 
curate result for £(r) on large scales, on which the 
linear perturbation theory result for the ratio of 
redshift space to real space correlation functions 
will be valid (Kaiser 1987). 

We have estimated the angular correlation 
function for the APM survey split up into several 
magnitude slices; figure 5 shows w(9) for the 17 < 
bj < 18, 17 < bj < 19 and 17 < bj < 20 slices in 
order of decreasing amplitude. We have also calcu- 
lated w(9) for one magnitude slices: 18 < bj < 19 
and 19 < bj < 20. The angular correlation func- 
tion was estimated by applying the ensemble es- 
timator to the Survey in the form of pixel maps 
(Maddox et al. 1990). 

Using our parameterisation of the redshift 
distribution of APM galaxies, we can calculate the 
mean redshift of the galaxies in each slice. This 
gives us an indication of the typical absolute mag- 
nitude of the galaxies in each slice, shown by the 
range in absolute magnitude that can be seen at 
the mean redshift, listed in Table 1. 

Maddox et al. (1990) demonstrate the scal- 
ing with depth of w(9) measured from different 
magnitude slices. This provides a test of the 'fair- 
ness' of the survey (Peebles 1980) and of the pa- 
rameterisation of the luminosity function or red- 
shift distribution of the survey galaxies. We shall 
apply the analogous test here, by computing the 
spatial correlation function for each of the w(9) 
curves described above. Given the large differences 
between the angular correlations before any scal- 
ing is applied in Figure 5, the recovery of a uni- 
versal form for {(r) is a stong test of our param- 
eterisation of the redshift distribution and our as- 
sumptions about the evolution of clustering. 



We recover P(k) for each slice using the 
method of BE93, and then take the Fourier trans- 
form to obtain {(r). The results are shown in Fig- 
ures 6 where we have assumed that the clustering 
is fixed in comoving co-ordinates. 

The results for the brightest slice are shown 
by the points with the la errors, with {(r) for the 
other slices shown by the lines. The {(r) recovered 
from each magnitude slice of the APM Survey are 
consistent within one sigma errors, especially for 
the broader magnitude slices. 

There are several explanations for the small 
discrepancy between the correlation function re- 
covered from the various magnitude slices. The 
w(9) used are uncorrected for the merging of im- 
ages. For the 17 < bj < 20 slice, this correc- 
tion is estimated to be in the region of a boost 
in amplitude of ~ 15% (Maddox et al. 1990, 
Gaztanaga 1994). The corrections for each mag- 
nitude slice will be different. However, the best 
correction to make would be to each zone indi- 
vidually, rather than adjusting the mean of the 
w(9), as the two zones nearest the Galactic plane 
are affected the most. For the narrow magnitude 
slices in Figure 6(b), the parametric form that 
that we have adopted for the redshift distribution 
may not give the best representation of distribu- 
tion for the slice. Finally, we could be seeing the 
effects of luminosity segregation on the amplitude 
of the correlation function. L95a, b have shown 
that there is some evidence for the faintest galax- 
ies in the Stromlo-APM survey being less strongly 
clustered than galaxies of the characteristic lumi- 
nosity M + , = —19.50 and brighter. This affect is 
cleaner in volume limited samples however, where 
the distance cut corresponds to a cut in absolute 
magnitude. 



6 ESTIMATING REDSHIFT SPACE 
DISTORTIONS 

Peculiar motions of galaxies distort the pat- 
tern of clustering when the galaxy positions are 
mapped using distances derived from their red- 
shifts. The direction averaged correlation function 
in redshift space, {(s), is related to the real space 
correlation function, {(r), on scales where linear 
perturbation theory is valid by (Kaiser 1987) 

^ = 1 + 2/3/? + 1/5 f, (13) 

where and b is the 'bias' parameter 

relating the fluctuations in mass to those in the 
galaxy distribution (&) = b . 

* P ' g ^ P ' m 

Ideally, one would like to apply this formula 
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Table 2. Redshift space distortions measured from APM Surveys 



Source/Model 


fj = Q uo /b 


1(7 


range 


2(7 


range 


Tadros et ah (95a) 


0.55 


0.21 


- 0.89 






L95b 


0.36 






-0.03 


- 0.75 


U = l,a = 


0.61 


0.38 


- 0.81 


0.15 


- 0.99 


fi = l,a = 2 


0.20 


-0.02 


- 0.39 


-0.26 


- 0.57 


fi = 0.2, a = 


0.45 


0.22 


- 0.66 


-0.02 


- 0.83 
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Figure 7. The APM Survey £(r) compared with the 
correlation function measured by L95a,b for the APM 
Stromlo Survey. The lines correspond to the real space 
correlation function: the solid line is for Q = 1, a = 0; 
the dotted line is for Q = 1, a = 2. The points in (a) 
are the real space £(r) for the Stromlo- APM Survey, the 
points in (b) are the redshift space correlation function. 
The error bars are from nine bootstrap resamplings of 
the redshift survey. 



on the largest scales possible, within the limit of 
the depth of the survey, in order to estimate the 
size of the peculiar velocity distortions. However, 
the estimates of the redshift space correlation func- 
tion from the Stromlo-APM Survey become noisy 
on scales r > 30/t _1 Mpc. 

The range of scales on which linear per- 
turbation theory is valid has been studied using 
the results of N-body simulations by Baugh & 
Efstathiou (1994) and Baugh, Gaztanaga & Ef- 
stathiou 1995. These authors found that mildly 
nonlinear evolution of the density field causes 
a transfer of power from large to small scales, 
for CDM like power spectra. On scales between 
lO-SO/t^Mpc the size of this effect was typically 
to reduce the correlations by a factor of ~< 10%. 

A further nonlinear effect is the small scale 
damping of correlations in redshift space caused 
by virialised motions. Over some range of scales, 
which can best be determined from N-body simu- 
lations that have a similar power spectrum to that 
observed (Tadros & Efstathiou 1995b), there will 
be a mixture of this damping effect and the boost 
in amplitude predicted by equation 13. In this pa- 
per, we will examine the ratio of the redshift space 
to real space correlation functions over the range 
8 < r < 25/t -1 Mpc, and make the approximation 
that the damping due to virialised motions is neg- 
ligible over these scales. This is larger than the 
scales used by L95b (who used 5 - 12/t _1 Mpc), 
because our estimate of the real space correlation 
function is smoother and less noisy on larger scales. 
However, Tadros & Efstathiou 1995a, b have made 
an estimate of fi by measuring the redshift space 
power spectrum for the Stromlo-APM Survey, in 
comparison with the P(k) of BE93, on much larger 
scales, A = 2w/k = 53 - 120/t _1 Mpc. 

We compare the Stromlo-APM Survey cor- 
relation functions, with the real space correlation 
function measured from the APM Survey in Fig- 
ure 7, on the scales where we examine the red- 
shift space distortions. The solid lines in the figure 
show the real space <J(r) estimated for Q = 1 and 
with clustering fixed in comoving coordinates: the 
dashed lines show <J(r) for clustering that evolves 
according to linear perturbation theory (a = 2). 
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Figure 7(a) shows the real space £(r) estimated 
by L95a, using the cross-correlation technique of 
Saunders et al. (1992), plotted as filled points with 
bootstrap errors. Figure 7(b) shows the redshift 
space correlation function. 

To determine the ratio between the redshift 
space and real space correlation function, we have 
taken the Fourier transfrom of the APM Survey 
P(k) at the values of r for which L95a measured 
Adding in quadrature the bootstrap errors 
on and the zone dispersion errors on £(r), we 
estimate the value of fi that minimises \ 2 an d give 
errors corresponding to A\ 2 = 1 (If) and A\ 2 = 
4 (2a). 

We compare our results with those of L95b 
and Tadros & Efstathiou 1995a in Table 2. We give 
results for different assumptions about the evolu- 
tion of clustering. Note that L95a,b have assumed 
that fi = 1 in calculating distances and absolute 
magnitudes for the Stromlo-APM galaxies. The 
values of fi given in table 2 are consistent within 
lcr. However, there are additional uncertainties in 
our estimate of fi. We have not corrected w(9) for 
contamination by merged images, which could in- 
crease the amplitude of the real space £(r) by 15%, 
and thus would lead to lower estimates of fi. Also, 
Gaztanaga (1995) has shown that different forms 
for the APM Survey luminosity function can lead 
to a 10% uncertainty in the value of <r&. 



7 SUMMARY 

We have estimated the real space correlation func- 
tion by taking the Fourier transform of the APM 
power spectrum, measured by BE93 and also by 
applying Lucy's method directly to the relativistic 
form of Limber's equation, relating w(9) to £(r). 

We have compared these results to the real 
space £(r) obtained from the shallower Stromlo- 
APM Survey using a technique developed by Saun- 
ders et al. (1992). The form of the correlation func- 
tion that we recover on large scales is smoother 
than that resulting from the cross-correlation anal- 
ysis. For fi = 1 and clustering that is fixed in 
comoving coordinates, the correlation function on 
scales r < 4/t -1 Mpc is well fitted by a power law 
£(r) = (r/4.1) -1 ' 7 . There is a shoulder in £(r) 
at 4/t _1 Mpc < r < 25/t _1 Mpc, with the cor- 
relation function rising above the quoted power 
law. The real space £(r) becomes consistent with 
zero, within the la errors on scales greater than 
r ~ 40/t -1 Mpc. If we make the assumption that 
clustering evolves according to linear perturbation 
theory, the shape of £(r) is unchanged, though the 
amplitude is increased, with the the correlation 
length r = 5.25/t _1 Mpc. 
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Figure 8. The real space for Q = 1, with a = 
(solid line) and a = 2 (dashed line) compared with the 
redshift space correlation function of the 1.2 J y survey 
(filled circles) and the Stromlo-APM survey (open cir- 
cles). 
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Figure 9. The second moment of the correlation func- 
tion computed using the £(r) recovered for each zone 
of the APM Survey. The filled circles show the mean of 
these estimates, with 1<7 error bars. The cuvres show 
the prediction of CDM models, all normalised to give 
<7 8 = 1: r = Mi = 0.2 (solid line), T = 0.3 (dashed 
line); T = 0.5 (dotted line). The open squares show a 
calculation of J3 for the T = 0.3 case using the nonlin- 
ear correlation function. 
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The value of fi that is measured in this pa- 
per agrees within the la errors with the other pub- 
lished values for APM/Stromlo-APM Survey anal- 
yses. With the lowest amplitude estimate that we 
obtain for £(r) , namely assuming that clustering is 
fixed in comoving coordinates and without apply- 
ing any corrections to w(9) for merging of images, 
we still rule out fi = fi°' 6 /6 = 1 at the 2a level. 
Hence, to retain an fi = 1 universe, a value of the 
bias parameter b > 1 is required on large scales, 
which is not supported by measurements of the 
higher order moments of counts in cells of APM 
galaxies (Gaztanaga 1994). 

A detailed presentation of how the three 
dimensional P(k) compares with theoretical mod- 
els and with the analysis of redshift surveys was 
presented in BE93. Here we restrict ourselves to 
a comparison of our results with the 1.2 J y IRAS 
Survey (Fisher et al. 1994) and the Stromlo-APM 
Survey in Figure 8. The solid line gives the real 
space correlation function that we obtain for fi = 1 
with clustering fixed in comoving coordinates; the 
dashed line shows the result for clustering that 
evolves according to linear perturbation theory. 
The filled circles give the redshift space correlation 
function for the fully sampled 1.2Jy IRAS survey 
of 5313 galaxies from Table 2 of Fisher et al. 1994. 
The open circles show {(s) for Stromlo-APM red- 
shift survey (L95a,b) This shows the bias in clus- 
tering between optical and infrared selected galax- 
ies. The Stromlo Survey is sparsely sampled and 
so does not extend to as small scales as the fully 
sampled 1.2 J y survey. The excess correlations on 
small scales in real space compared with redshift 
space are clearly apparent. On larger scales, the 
enhancement of clustering in redshift space is less 
apparent, particularly in view of the uncertainties 
in the amplitude of the real space correlation func- 
tion. These correction would generally tend to in- 
crease the amplitude of {(r), reducing the value of 
fi. 

We also give a calculation of the sec- 
ond moment of the correlation function h^r) = 
Jo J,2 {( J ')dj', which is used to normalise theoretical 
models for structure formation and is used to give 
the minimum variance weighting when calculat- 
ing the correlation function in flux limited redshift 
surveys. We have calculated Js(r) using {(r) mea- 
sured for each zone of the APM Survey. The points 
in Figure 9 show the mean of these estimates with 
la error bars. The curves show the predictions of 
CDM like models, specified by the shape parame- 
ter T = fi/t (see e.g. Efstathiou 1995). The theo- 
retical curves have all been normalised so that the 
variance measured in spheres of radius 8/t -1 Mpc 
is unity. The solid line shows the form of Js(r) 
for a linear perturbation theory CDM power spec- 
trum characterised by T = 0.2; the dashed line is 



for T = 0.3 and the dotted line gives the standard 
CDM model T = 0.5. The estimates of Js(r) on 
large scales reflect the uncertainty in {(r) on these 
scales, enhanced by the r 2 weighting. The open 
squares show the result of a calculation of Js(r) 
using an approximation to the non linear shape 
of the two point correlation function. This was ob- 
tained by applying the linear to nonlinear transfor- 
mation for the power spectrum described by Jain, 
Mo and White (1995). 

One can see that Js(r) is insensitve to non- 
linear evolution on large scales. On small scales, 
there is disagreement between the shape of J3 for 
the T = 0.3 model and the observations. There 
are a number of possible explanations for this: (i) 
there is evidence that a larger value of the clus- 
tering evolution parameter is more appropriate on 
small scales; (ii) some form of linear bias should 
be applied to the galaxy correlation function: as 
mentioned above the higher order moments of 
counts in the APM Survey do not support this on 
large scales (Gaztanaga 1994); (iii) CDM like mod- 
els specified by the T parameter have the wrong 
shape; (iv) some form of scale dependent bias fac- 
tor is necessary. 
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